Deep Learning With Chest Radiographs for Making Prognoses in Patients With COVID-19: Retrospective Cohort Study.

BACKGROUND: An artificial intelligence (AI) model using chest radiography (CXR) may provide good performance in making prognoses for COVID-19. OBJECTIVE: We aimed to develop and validate a prediction model using CXR based on an AI model and clinical variables to predict clinical outcomes in patients with COVID-19. METHODS: This retrospective longitudinal study included patients hospitalized for COVID-19 at multiple COVID-19 medical centers between February 2020 and October 2020. Patients at Boramae Medical Center were randomly classified into training, validation, and internal testing sets (at a ratio of 8:1:1, respectively). An AI model using initial CXR images as input, a logistic regression model using clinical information, and a combined model using the output of the AI model (as CXR score) and clinical information were developed and trained to predict hospital length of stay (LOS) ≤2 weeks, need for oxygen supplementation, and acute respiratory distress syndrome (ARDS). The models were externally validated in the Korean Imaging Cohort of COVID-19 data set for discrimination and calibration. RESULTS: The AI model using CXR and the logistic regression model using clinical variables were suboptimal to predict hospital LOS ≤2 weeks or the need for oxygen supplementation but performed acceptably in the prediction of ARDS (AI model area under the curve [AUC] 0.782, 95% CI 0.720-0.845; logistic regression model AUC 0.878, 95% CI 0.838-0.919). The combined model performed better in predicting the need for oxygen supplementation (AUC 0.704, 95% CI 0.646-0.762) and ARDS (AUC 0.890, 95% CI 0.853-0.928) compared to the CXR score alone. Both the AI and combined models showed good calibration for predicting ARDS (P=.079 and P=.859). CONCLUSIONS: The combined prediction model, comprising the CXR score and clinical information, was externally validated as having acceptable performance in predicting severe illness and excellent performance in predicting ARDS in patients with COVID-19.

Implementation of a Deep Learning-Based Computer-Aided Detection System for the Interpretation of Chest Radiographs in Patients Suspected for COVID-19.

OBJECTIVE: To describe the experience of implementing a deep learning-based computer-aided detection (CAD) system for the interpretation of chest X-ray radiographs (CXR) of suspected coronavirus disease (COVID-19) patients and investigate the diagnostic performance of CXR interpretation with CAD assistance. MATERIALS AND METHODS: In this single-center retrospective study, initial CXR of patients with suspected or confirmed COVID-19 were investigated. A commercialized deep learning-based CAD system that can identify various abnormalities on CXR was implemented for the interpretation of CXR in daily practice. The diagnostic performance of radiologists with CAD assistance were evaluated based on two different reference standards: 1) real-time reverse transcriptase-polymerase chain reaction (rRT-PCR) results for COVID-19 and 2) pulmonary abnormality suggesting pneumonia on chest CT. The turnaround times (TATs) of radiology reports for CXR and rRT-PCR results were also evaluated. RESULTS: Among 332 patients (male:female, 173:159; mean age, 57 years) with available rRT-PCR results, 16 patients (4.8%) were diagnosed with COVID-19. Using CXR, radiologists with CAD assistance identified rRT-PCR positive COVID-19 patients with sensitivity and specificity of 68.8% and 66.7%, respectively. Among 119 patients (male:female, 75:44; mean age, 69 years) with available chest CTs, radiologists assisted by CAD reported pneumonia on CXR with a sensitivity of 81.5% and a specificity of 72.3%. The TATs of CXR reports were significantly shorter than those of rRT-PCR results (median 51 vs. 507 minutes; p < 0.001). CONCLUSION: Radiologists with CAD assistance could identify patients with rRT-PCR-positive COVID-19 or pneumonia on CXR with a reasonably acceptable performance. In patients suspected with COVID-19, CXR had much faster TATs than rRT-PCRs.

Self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation.

Although deep learning-based computer-aided diagnosis systems have recently achieved expert-level performance, developing a robust model requires large, high-quality data with annotations that are expensive to obtain. This situation poses a conundrum that annually-collected chest x-rays cannot be utilized due to the absence of labels, especially in deprived areas. In this study, we present a framework named distillation for self-supervision and self-train learning (DISTL) inspired by the learning process of the radiologists, which can improve the performance of vision transformer simultaneously with self-supervision and self-training through knowledge distillation. In external validation from three hospitals for diagnosis of tuberculosis, pneumothorax, and COVID-19, DISTL offers gradually improved performance as the amount of unlabeled data increase, even better than the fully supervised model with the same amount of labeled data. We additionally show that the model obtained with DISTL is robust to various real-world nuisances, offering better applicability in clinical setting.

Applications of artificial intelligence in the thorax: a narrative review focusing on thoracic radiology.

OBJECTIVE: This review will focus on how AI-and, specifically, deep learning-can be applied to complement aspects of the current healthcare system. We describe how AI-based tools can augment existing clinical workflows by discussing the applications of AI to worklist prioritization and patient triage, the performance-boosting effects of AI as a second reader, and the use of AI to facilitate complex quantifications. We also introduce prominent examples of recent AI applications, such as tuberculosis screening in resource-constrained environments, the detection of lung cancer with screening CT, and the diagnosis of COVID-19. We also provide examples of prognostic predictions and new discoveries beyond existing clinical practices. BACKGROUND: Artificial intelligence (AI) has shown promising performance for thoracic diseases, particularly in the field of thoracic radiology. However, it has not yet been established how AI-based image analysis systems can help physicians in clinical practice. METHODS: This review included peer-reviewed research articles on AI in the thorax published in English between 2015 and 2021. CONCLUSIONS: With advances in technology and appropriate preparation of physicians, AI could address various clinical problems that have not been solved due to a lack of clinical resources or technological limitations. KEYWORDS: Artificial intelligence (AI); deep learning (DL); computer aided diagnosis (CAD); thoracic radiology; pulmonary medicine.

Erratum: Extension of Coronavirus Disease 2019 (COVID-19) on Chest CT and Implications for Chest Radiograph Interpretation.

[This corrects the article DOI: 10.1148/ryct.2020200107.].

COVID-19 pneumonia on chest X-rays: Performance of a deep learning-based computer-aided detection system.

Chest X-rays (CXRs) can help triage for Coronavirus disease (COVID-19) patients in resource-constrained environments, and a computer-aided detection system (CAD) that can identify pneumonia on CXR may help the triage of patients in those environment where expert radiologists are not available. However, the performance of existing CAD for identifying COVID-19 and associated pneumonia on CXRs has been scarcely investigated. In this study, CXRs of patients with and without COVID-19 confirmed by reverse transcriptase polymerase chain reaction (RT-PCR) were retrospectively collected from four and one institution, respectively, and a commercialized, regulatory-approved CAD that can identify various abnormalities including pneumonia was used to analyze each CXR. Performance of the CAD was evaluated using area under the receiver operating characteristic curves (AUCs), with reference standards of the RT-PCR results and the presence of findings of pneumonia on chest CTs obtained within 24 hours from the CXR. For comparison, 5 thoracic radiologists and 5 non-radiologist physicians independently interpreted the CXRs. Afterward, they re-interpreted the CXRs with corresponding CAD results. The performance of CAD (AUCs, 0.714 and 0.790 against RT-PCR and chest CT, respectively hereinafter) were similar with those of thoracic radiologists (AUCs, 0.701 and 0.784), and higher than those of non-radiologist physicians (AUCs, 0.584 and 0.650). Non-radiologist physicians showed significantly improved performance when assisted with the CAD (AUCs, 0.584 to 0.664 and 0.650 to 0.738). In addition, inter-reader agreement among physicians was also improved in the CAD-assisted interpretation (Fleiss' kappa coefficient, 0.209 to 0.322). In conclusion, radiologist-level performance of the CAD in identifying COVID-19 and associated pneumonia on CXR and enhanced performance of non-radiologist physicians with the CAD assistance suggest that the CAD can support physicians in interpreting CXRs and helping image-based triage of COVID-19 patients in resource-constrained environment.

Erratum: Extension of Coronavirus Disease 2019 on Chest CT and Implications for Chest Radiographic Interpretation.

[This corrects the article DOI: 10.1148/ryct.2020200107.].

Extension of Coronavirus Disease 2019 on Chest CT and Implications for Chest Radiographic Interpretation.

PURPOSE: To study the extent of pulmonary involvement in coronavirus 19 (COVID-19) with quantitative CT and to assess the impact of disease burden on opacity visibility on chest radiographs. MATERIALS AND METHODS: This retrospective study included 20 pairs of CT scans and same-day chest radiographs from 17 patients with COVID-19, along with 20 chest radiographs of controls. All pulmonary opacities were semiautomatically segmented on CT images, producing an anteroposterior projection image to match the corresponding frontal chest radiograph. The quantitative CT lung opacification mass (QCTmass) was defined as (opacity attenuation value + 1000 HU)/1000 × 1.065 (g/mL) × combined volume (cm3) of the individual opacities. Eight thoracic radiologists reviewed the 40 radiographs, and a receiver operating characteristic curve analysis was performed for the detection of lung opacities. Logistic regression analysis was performed to identify factors affecting opacity visibility on chest radiographs. RESULTS: The mean QCTmass per patient was 72.4 g ± 120.8 (range, 0.7-420.7 g), and opacities occupied 3.2% ± 5.8 (range, 0.1%-19.8%) and 13.9% ± 18.0 (range, 0.5%-57.8%) of the lung area on the CT images and projected images, respectively. The radiographs had a median sensitivity of 25% and specificity of 90% among radiologists. Nineteen of 186 opacities were visible on chest radiographs, and a median area of 55.8% of the projected images was identifiable on radiographs. Logistic regression analysis showed that QCTmass (P < .001) and combined opacity volume (P < .001) significantly affected opacity visibility on radiographs. CONCLUSION: QCTmass varied among patients with COVID-19. Chest radiographs had high specificity for detecting lung opacities in COVID-19 but a low sensitivity. QCTmass and combined opacity volume were significant determinants of opacity visibility on radiographs.Earlier incorrect version appeared online. This article was corrected on April 6, 2020 and December 14, 2020.Supplemental material is available for this article.© RSNA, 2020.

Establishment of a Nationwide Korean Imaging Cohort of Coronavirus Disease 2019.

BACKGROUND: The Korean Society of Thoracic Radiology (KSTR) recently constructed a nation-wide coronavirus disease 2019 (COVID-19) database and imaging repository, referred to the Korean imaging cohort of COVID-19 (KICC-19) based on the collaborative efforts of its members. The purpose of this study was to provide a summary of the clinico-epidemiological data and imaging data of the KICC-19. METHODS: The KSTR members at 17 COVID-19 referral centers retrospectively collected imaging data and clinical information of consecutive patients with reverse transcription polymerase chain reaction-proven COVID-19 in respiratory specimens from February 2020 through May 2020 who underwent diagnostic chest computed tomography (CT) or radiograph in each participating hospital. RESULTS: The cohort consisted of 239 men and 283 women (mean age, 52.3 years; age range, 11-97 years). Of the 522 subjects, 201 (38.5%) had an underlying disease. The most common symptoms were fever (n = 292) and cough (n = 245). The 151 patients (28.9%) had lymphocytopenia, 86 had (16.5%) thrombocytopenia, and 227 patients (43.5%) had an elevated CRP at admission. The 121 (23.4%) needed nasal oxygen therapy or mechanical ventilation (n = 38; 7.3%), and 49 patients (9.4%) were admitted to an intensive care unit. Although most patients had cured, 21 patients (4.0%) died. The 465 (89.1%) subjects underwent a low to standard-dose chest CT scan at least once during hospitalization, resulting in a total of 658 CT scans. The 497 subjects (95.2%) underwent chest radiography at least once during hospitalization, which resulted in a total of 1,475 chest radiographs. CONCLUSION: The KICC-19 was successfully established and comprised of 658 CT scans and 1,475 chest radiographs of 522 hospitalized Korean COVID-19 patients. The KICC-19 will provide a more comprehensive understanding of the clinical, epidemiological, and radiologic characteristics of patients with COVID-19.

Clinical Validation of a Deep Learning Algorithm for Detection of Pneumonia on Chest Radiographs in Emergency Department Patients with Acute Febrile Respiratory Illness.

Early identification of pneumonia is essential in patients with acute febrile respiratory illness (FRI). We evaluated the performance and added value of a commercial deep learning (DL) algorithm in detecting pneumonia on chest radiographs (CRs) of patients visiting the emergency department (ED) with acute FRI. This single-centre, retrospective study included 377 consecutive patients who visited the ED and the resulting 387 CRs in August 2018-January 2019. The performance of a DL algorithm in detection of pneumonia on CRs was evaluated based on area under the receiver operating characteristics (AUROC) curves, sensitivity, specificity, negative predictive values (NPVs), and positive predictive values (PPVs). Three ED physicians independently reviewed CRs with observer performance test to detect pneumonia, which was re-evaluated with the algorithm eight weeks later. AUROC, sensitivity, and specificity measurements were compared between "DL algorithm" vs. "physicians-only" and between "physicians-only" vs. "physicians aided with the algorithm". Among 377 patients, 83 (22.0%) had pneumonia. AUROC, sensitivity, specificity, PPV, and NPV of the algorithm for detection of pneumonia on CRs were 0.861, 58.3%, 94.4%, 74.2%, and 89.1%, respectively. For the detection of 'visible pneumonia on CR' (60 CRs from 59 patients), AUROC, sensitivity, specificity, PPV, and NPV were 0.940, 81.7%, 94.4%, 74.2%, and 96.3%, respectively. In the observer performance test, the algorithm performed better than the physicians for pneumonia (AUROC, 0.861 vs. 0.788, p = 0.017; specificity, 94.4% vs. 88.7%, p < 0.0001) and visible pneumonia (AUROC, 0.940 vs. 0.871, p = 0.007; sensitivity, 81.7% vs. 73.9%, p = 0.034; specificity, 94.4% vs. 88.7%, p < 0.0001). Detection of pneumonia (sensitivity, 82.2% vs. 53.2%, p = 0.008; specificity, 98.1% vs. 88.7%; p < 0.0001) and 'visible pneumonia' (sensitivity, 82.2% vs. 73.9%, p = 0.014; specificity, 98.1% vs. 88.7%, p < 0.0001) significantly improved when the algorithm was used by the physicians. Mean reading time for the physicians decreased from 165 to 101 min with the assistance of the algorithm. Thus, the DL algorithm showed a better diagnosis of pneumonia, particularly visible pneumonia on CR, and improved diagnosis by ED physicians in patients with acute FRI.

Chest Radiographic and CT Findings of the 2019 Novel Coronavirus Disease (COVID-19): Analysis of Nine Patients Treated in Korea.

OBJECTIVE: This study presents a preliminary report on the chest radiographic and computed tomography (CT) findings of the 2019 novel coronavirus disease (COVID-19) pneumonia in Korea. MATERIALS AND METHODS: As part of a multi-institutional collaboration coordinated by the Korean Society of Thoracic Radiology, we collected nine patients with COVID-19 infections who had undergone chest radiography and CT scans. We analyzed the radiographic and CT findings of COVID-19 pneumonia at baseline. Fisher's exact test was used to compare CT findings depending on the shape of pulmonary lesions. RESULTS: Three of the nine patients (33.3%) had parenchymal abnormalities detected by chest radiography, and most of the abnormalities were peripheral consolidations. Chest CT images showed bilateral involvement in eight of the nine patients, and a unilobar reversed halo sign in the other patient. In total, 77 pulmonary lesions were found, including patchy lesions (39%), large confluent lesions (13%), and small nodular lesions (48%). The peripheral and posterior lung fields were involved in 78% and 67% of the lesions, respectively. The lesions were typically ill-defined and were composed of mixed ground-glass opacities and consolidation or pure ground-glass opacities. Patchy to confluent lesions were primarily distributed in the lower lobes (p = 0.040) and along the pleura (p < 0.001), whereas nodular lesions were primarily distributed along the bronchovascular bundles (p = 0.006). CONCLUSION: COVID-19 pneumonia in Korea primarily manifested as pure to mixed ground-glass opacities with a patchy to confluent or nodular shape in the bilateral peripheral posterior lungs. A considerable proportion of patients with COVID-19 pneumonia had normal chest radiographs.